Holistic indoor scene understanding by context-supported instance segmentation

نویسندگان

چکیده

We propose a new method flow that utilizes pixel-level labeling information for instance-level object detection in indoor scenes from RGB-D data. Semantic and instance segmentation are two different paradigms scene understanding usually accomplished separately independently. interested integrating the tasks synergistic way order to take advantage of their complementary nature comprehensive understanding. Our work can capitalize on any deep learning networks used semantic by treating intermediate layer as category-wise local output, which is optimized jointly considering both spatial fitness relational context encoded three graphical models, namely, vertical placement model (VPM), horizontal (HPM) non-placement (NPM). VPM, HPM NPM represent common but distinct configurations: vertical, hanging relationships, respectively. Experimental results standard datasets show our significantly improve small with promising overall performance competitive state-of-the-art methods.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Holistic Scene Understanding

This report documents the program and the outcomes of Dagstuhl Seminar 15081 “Holistic Scene Understanding”. During the seminar, several participants presented their current research, and ongoing work and open problems were discussed. Abstracts of the presentations given during the seminar as well as abstracts of seminar results and ideas are put together in this paper. The first section descri...

متن کامل

PixelLink: Detecting Scene Text via Instance Segmentation

Most state-of-the-art scene text detection algorithms are deep learning based methods that depend on bounding box regression and perform at least two kinds of predictions: text/nontext classification and location regression. Regression plays a key role in the acquisition of bounding boxes in these methods, but it is not indispensable because text/non-text prediction can also be considered as a ...

متن کامل

Continuous Factor Graphs for Holistic Scene Understanding

We propose a novel mathematical formulation for the holistic scene understanding problem and transform it from the discrete into the continuous domain. The problem can then be modeled with a nonlinear continuous factor graph, and the MAP solution is found via least squares optimization. We evaluate our method on the realistic NYU2 dataset.

متن کامل

Fusion Based Holistic Road Scene Understanding

This paper addresses the problem of holistic road scene understanding based on the integration of visual and range data. To achieve the grand goal, we propose an approach that jointly tackles object-level image segmentation and semantic region labeling within a conditional random field (CRF) framework. Specifically, we first generate semantic object hypotheses by clustering 3D points, learning ...

متن کامل

Support surfaces prediction for indoor scene understanding

In this paper, we present an approach to predict the extent and height of supporting surfaces such as tables, chairs, and cabinet tops from a single RGBD image. We define support surfaces to be horizontal, planar surfaces that can physically support objects and humans. Given a RGBD image, our goal is to localize the height and full extent of such surfaces in 3D space. To achieve this, we create...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Multimedia Tools and Applications

سال: 2021

ISSN: ['1380-7501', '1573-7721']

DOI: https://doi.org/10.1007/s11042-021-11145-y